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What Factors Predict Middle School Students Sign Up for Washington's College Bound 
Scholarship Program? A Mixed Methods Evaluation 
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January 2017 


Abstract 

We investigate factors influencing student sign-ups for Washington State's College Bound Scholarship 
(CBS) program. We find a substantial share of eligible middle school students fail to sign the CBS, 
forgoing college financial aid. Student characteristics associated with signing the scholarship parallel 
characteristics of low-income students who attend 4-year colleges. Simulations suggest the program 
may address college enrollment gaps, increasing college-going by some disadvantaged groups, it also 
would reinforce inequalities in college-going that exist between sub-groups of low-income students. 
Finally, student sign-up rates are lower than has been previously reported. Importantly, we find a 
perception among program administrators that nearly all eligible students sign up, which shifts attention 
away from sign-ups to encouraging pledgees to follow through with program requirements. 



1. Introduction 


In 2007, the Washington State legislature created a need-based scholarship program to 
encourage economically disadvantaged middle school students to "choose a path that will lead to 
educational success after high school." Under Washington's College Bound Scholarship (CBS) program, 
low-income students sign a pledge in the 7 th or 8 th grade (or 9 th grade for one cohort), pledging to: 1) do 
well in middle and high school; 2) be a good citizen and not be convicted of a felony; and 3) apply for 
financial aid to college. 1 If they satisfy these requirements, and their family income remains below a 
threshold in their senior year, they are promised a scholarship that covers the tuition and fees (plus a 
small book allowance) that are not covered by other state financial aid awards, to attend an eligible 
Washington State higher education institution. 

Students have a strong incentive to sign up for the CBS program given that the potential college 
tuition benefits are significant and the costs of signing the pledge are negligible. Yet a substantial 
proportion of students do not sign the pledge and there is considerable heterogeneity in sign-up rates 
across school districts. In this mixed-methods research we identify factors that help explain whether 
students sign the pledge and the potential reasons for differential sign-up rates in some schools and 
districts. Specifically, the paper addresses the following questions: (A) What student and middle school 
characteristics are associated with the student's likelihood to sign the pledge and thus participate in the 
CBS program?; and (B) What do program administrators report doing to encourage student uptake? 

Our study finds that factors associated with sign-up are similar to factors associated with 
enrollment in college. For example, among eligible middle school students, females are both more likely 
to enroll in college and are more likely to sign up for the program. Since students who do not sign up for 
the program are ineligible for the college financial aid that comes from the program, this 
correspondence of factors affecting sign-up and college enrollment suggests that this "opt-in" program 
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may reinforce existing disparities in college enrollment among the target population of low-income 
students. 

Importantly, the availability of individual-level student records allows us to calculate a more 
accurate CBS sign up rate than the rate that has been previously reported. The rate we calculate shows a 
substantial increase over time in the proportion of students who sign the CBS pledge; an increase in line 
with what has been documented in prior state reports. However, we estimate that the overall 
proportion of eligible students who have signed the pledge is far lower than the state's estimate (by 
about 20 percentage points or just over 30 percent). Such a substantial difference may affect the way 
CBS program staff allocate their efforts to promote the CBS program and encourage college-going since 
many would assume that they are far closer to the goal of signing up all eligible students than they 
actually are. 

The qualitative component of our study is based on semi-structured interviews with middle 
school guidance counselors, middle school principals, and the CBS regional officers (ROs) - individuals 
employed by the nonprofit College Success Foundation assigned to conduct program outreach in 
Washington's nine Educational Service Districts through a contract with the Office of Superintendent for 
Public Instruction (OSPI). We find that, from the perspective of the program's ROs the schools that are 
most successful at signing-up students (1) have district-level "buy-in" and support for the program, 
coupled with a school-level champion who takes "ownership" of the program; (2) obtain the list of 
students eligible for free and reduced lunch so that counselors or other school staff with CBS 
responsibilities can target individual students who are eligible for the program; (3) have guidance 
counseling staff that are not over-burdened with other responsibilities and have good relationships with 
students; and (4) are in a community or district that has a strong or ingrained college-going culture. Yet 
ROs, citing the perceived high sign-up rates, largely agree that their role is shifting from encouraging 
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focus on student sign-up to encouraging high school students to complete the necessary steps to use 


the scholarship. 

Interviews with school counselors and principals suggest that schools generally have access to 
information about a portion of the eligible students (the list of students eligible for free and reduced 
lunch) and at least one school-level champion tasked with encouraging students to sign the CBS pledge. 
However, the qualitative analysis suggests there is ample variation in counselor workload, college-going 
culture, and encouragement for students to sign the CBS pledge. Additionally, middle school guidance 
counselors and principals made clear that the amount of time it took to track down completed pledge 
sheets left little time for promoting college among their students. 

To our knowledge this is the first paper investigating the factors influencing whether students 
sign up for an early commitment pledge for college financial aid. Understanding why eligible students 
opt not to sign up is import. These pledge programs seek to change student trajectories well before 
college. And, more fundamentally, for many students the amount of college financial aid available to 
them will depend having signed the CBS pledge. 

2. Policy Background 

Over the past three decades there have been notable increases in the proportion of U.S. 
students enrolling in and graduating from college. Despite this, significant educational attainment gaps 
still exist between more advantaged (primarily high-income students and white) and disadvantaged 
(primarily low-income and minority students). 2 New evidence, in fact, shows an increase in income- 
based educational attainment gaps and a decline in intergenerational educational mobility (Duncan & 
Murnane, 2011), trends that are extremely problematic for both U.S. long-term economic 
competitiveness and social cohesion. Duncan & Murnane (2011) note: "American Society relies on its 
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schools to level the playing field for children born into different circumstances. More than any other 
institution, schools are charged with making equality of opportunity a reality" (p. 7). 

Empirical research has identified a variety of factors that contribute to the persistence of college 
enrollment gaps: low-income students often lack a good understanding of the academic requirements 
needed to be admitted and to succeed in college (Kirst, Venezia, & Antonio 2004; Rosenbaum 2001); 
they have lower educational expectations and are less likely to have taken courses necessary to succeed 
in college (Choy, 2001; Jacob & Linkow, 2011). Academically prepared, low-income students are less 
likely to apply to college as seniors and are "discouraged by the complexity of the process of applying for 
financial aid and college admissions, even if they are qualified and enthusiastic about going to college" 
(Avery & Kane, 2004, p. 356). 

Increasingly prevalent are state financial aid programs designed, in part, to address college 
enrollment and attainment gaps by offering low-income students an early promise of funding for college 
in exchange for a student's pledge (typically during 7 th -9 th grades) to do well in high school, be a good 
citizen, and apply to college. If a student fulfills the pledge, remains below a certain income level, and 
attends an eligible college, they are guaranteed funding for tuition and school fees. These "early 
commitment programs" are hypothesized to help low income students directly by making college more 
affordable and indirectly by signaling to them early enough that college is financially within their reach 
so that it changes their high school trajectory. In other words, the early promise of a college scholarship 
may raise students' expectations about the feasibility of college attendance, creating a strong incentive 
for them to do well in high school and fulfill pledge requirements. Understanding whether these types of 
programs increase student achievement and college access, and close educational attainment gaps, is 
vitally important. 

The CBS program was created by the Washington legislature in 2007 and is administered by the 
Washington Student Achievement Counsel (WSAC). 3 The program was patterned on similar programs in 
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Indiana (21st Century Scholars program initiated in 1990) and Oklahoma (Oklahoma's Promise initiated 


in 1996), with some notable differences that we describe below. 4 

The CBS program works as follows: If an eligible student signs the pledge, meets its obligations, 
and her family's income remains below a predetermined threshold by her senior year, the student 
receives a scholarship that covers tuition and fees (plus a small textbook allowance) which are not 
covered by other state financial aid awards. 5 The student can use the scholarship to attend any public or 
eligible private Washington state higher education institution. 6 A student is eligible to sign the CBS 
pledge if any of the following apply during her 7th or 8th grade year (or 9th grade for the first eligible 
cohort during 2008-09): the student was eligible for free or reduced-price lunch (FRPL), the student's 
family received Temporary Assistance for Needy Families (TANF), the student was a foster youth, or the 
student's family income was below 185% of the poverty line (which would also qualify the student for 
FRPL). 7 To enroll in the program, the student and her parent or legal guardian must both sign the pledge 
by June 30 th of the final year of eligibility. 

The text of the pledge reads as follows: 

"Yes, I am College Bound! I pledge that I will: 

• Graduate with a cumulative high school grade point average of 2.0 or 
higher [on a 4.0 scale], 

• Be a good citizen in school and in my community, and not be convicted 
of a felony while in high school. 

• Apply for financial aid by competing the FAFSA [Free Application for 
Federal Student Aid] in a timely manner when I apply for college." 

When the student enters her senior year, the student's family income during that year must fall 

within 65% of the state's median family income in order to be eligible to receive the College Bound 
financial aid. The fact that the CBS is contingent on family income during a student's senior year 
somewhat weakens the clarity of what rewards will follow from signing and fulfilling the pledge, though 
the increase in the income threshold for qualifying (e.g., rising from $39,220 in 8 th grade to $53,000 in 
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12 th grade for a family of four in the first cohort) implies that a great many of those students who 
initially sign up for the program will be eligible when the time comes to make college-going decisions. 8 
Should the student remain income-eligible in his or her senior year, the amount of guaranteed aid is 
both generous and transparent: 

The scholarship amount will be based on tuition rates at Washington public colleges and 
universities. It will cover the tuition and fees (plus a small book allowance) that are not 
covered by other state financial aid awards such as the State Need Grant. You will 
receive your scholarship through your college or university as part of your financial aid 
award (WHECB, 2012c). 

Students attending private institutions of higher education in Washington receive an amount 
equal to what the average student receives attending a comparable public institution in the state 
(typically the average award given at the University of Washington and Washington State University). 9 
Note that many private institutions, however, offer to cover whatever tuition costs remain after the CB 
scholarship is applied. CBS covers 8 semesters (12 quarters) so long as the student maintains satisfactory 
academic progress as determined by the college. The scholarship must be used within five years of high 
school graduation, and cannot be used for graduate school. 

Table 1 outlines the similarities and differences between CBS and early commitment scholarship 
programs operating in other states. Currently there are three states (Indiana, Oklahoma, and 
Washington) that are operating uniform, statewide programs that meet Blanco's (2005) "three core 
criteria for early commitment programs: that they make a guarantee of aid; that aid is designated only 
for economically disadvantaged students; and that students are identified in elementary, middle school, 
or early high school" (p. 9). 10 

Two key programmatic differences distinguish Washington's program from those in other states. 
First, until recently, the programs in Indiana and Oklahoma had no income requirement at the time that 
the student attended college. Heller (2006) noted, "[t] he distinguishing characteristic of these two 


6 



programs from that of other publicly funded aid programs is that once students are accepted into the 


program while in middle school, they will not be removed even if their family's economic circumstances 
change" (p. 1726). Washington, in contrast, designed its program with a restriction that the students' 
family income could not rise above 65% of the state's median family income ($53,000 for a family of 
four in 2012-13) during the senior year in high school. This income cap makes the CBS "promise" more 
uncertain. The recently adopted cap in Oklahoma of $100,000 creates less uncertainty, as few families' 
incomes are likely to rise from less than $50,000 to more than $100,000 during the student's high school 
years. 

A second distinguishing feature is that the programs in Indiana and Oklahoma require students 
to take specific college-appropriate coursework while in high school to be eligible for the scholarship aid. 
CBS, by contrast, places no coursework restrictions and merely has a relatively weak 2.0 grade point 
average as its only performance requirement. 11 

There is no financial cost for the student to sign up for CBS in middle school. To sign up for the 
scholarship program, eligible 7 th or 8 th graders, along with their parent or legal guardian, must sign the 
pledge form, which can be given to the student at school, mailed home, or can be printed from the 
College Bound website. After signing the pledge, students can turn their completed forms in to schools 
who will then pass them along to WSAC, or the forms may be mailed directly to WSAC. Eligible students 
have until June 30 th of their eighth grade year to submit a completed form (ninth grade for cohort 1). 

The method of publicizing the CBS opportunity is largely left to the discretion of schools and school 
districts with support from WSAC through the work of their contracted ROs. 12 Heterogeneity in 
communication may affect whether students know about the program, whether they choose to sign up, 
and whether they fully understand the program. 

Given the low burden to sign up, the relatively undemanding pledge that students are asked to 
make, juxtaposed against the guaranteed benefits and the fact that a high percentage of middle school 
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students anticipate attending college, it is surprising, as we discuss below, that sign-up rates are not 
uniformly high across the state. Consequently, our study is intended to help explain the factors that may 
be impeding a higher sign-up rate. 


3. Literature on Similar Programs and Program Take-up 

As noted above, increases in the proportion of U.S. students enrolling and graduating from 
college have been significant over the long term. However, more recently, gains in college completion 
have leveled off and there remain large educational attainment gaps between student sub-groups. For 
instance, in 2009, there was a 29-percentage point gap between students from low- and high-income 
families in the share attending either a two- or four-year college in the fall immediately after completing 
high school (Aud et al., 2011); there are similar gaps in Washington State (ERDC, 2012). 13 

There is a large and growing literature on the effects of merit-based financial aid on these 
educational gaps (e.g. Cornwell et al., 2006; Dynarski, 2008, Sjoquist & Winters, 2012). Early 
commitment college programs, however, have received very limited empirical scrutiny despite 
significant public attention. Early commitment programs offer promise as they are designed to address 
some of the hurdles confronting low-income students. Of note, students and parents often misestimate 
college costs (Ikenberry & Hartle 1998; Usher 2005), particularly low-income families (Avery & Kane 
2004; Grodsky & Jones 2007; Horn et al., 2003; Jacob & Linkow, 2011). This likely contributes to the fact 
that low-income families are also more likely to have inadequate funding (Long & Riley 2007). But, even 
when adequate funding is available (through scholarships, etc.), low-income students and families are 
less likely to know about funding options and less likely to apply for assistance (Bettinger et al., 2009; 
Hahn & Price 2008; Long & Riley 2007). For example, Dynarski & Scott-Clayton (2006) argue that 
complexities in the financial aid system, particularly in completing the Free Application for Federal 
Student Aid (FAFSA) "may prevent the subsidies from having their intended effect of inducing students 
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into college" (p. 319). Likewise, Bettinger et al. (2009) find that low- and moderate-income families who 


"received assistance with the FAFSA" during tax preparation were substantially more likely to submit the 
aid application, enroll in college the following fall, and receive more financial aid" (abstract). 

Once in college, there are numerous programs designed to help a student stay in and complete 
their postsecondary education, particularly for disadvantaged students. Indeed, there are over a 
thousand programs administered by federal and state government, universities, nonprofits, and 
community groups designed to address the attainment gap through a variety of approaches including 
mentoring, counseling, parental involvement, academic preparation, personal enrichment, and financial 
assistance (Gandara & Bial, 2001). 

To our knowledge, research has not explored the factors influencing whether and why students 
sign up for Washington's early commitment pledge. 14 This is an important gap in the financial aid and 
college-going literature given that a central theory of action of such pledge programs is that early 
commitment will change student trajectories toward college. The research also speaks more generally to 
a broader, though currently limited, literature on the take-up of social programs (e.g., Bitler, Currie, & 
Scholz, 2003; Currie, 2006). 


4. Methods and Data 

4.1 Quantitative Analytic Methods 

We begin with a quantitative analysis of the individual and school characteristics that predict 
the likelihood of a student signing the CBS pledge in middle school. To evaluate how individual and 
school characteristics predict the likelihood of eligible students signing the pledge, we estimate the 
specifications shown in Equations la and lb using data on the first three cohorts of CBS eligible 
students: 

(la) SiQ n edjr:, = F(Sq + S-^Xj + MSCEm + Sim) 
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(lb) Signed im = F(S 0 + AjX, + S 2 S m + s im ) 

The subscript / denotes the student and m denotes the middle school attended in 8 th grade. 15 
The dependent variable for this analysis, Signed im , is an indicator variable that equals one if the student 
signed the pledge by the end of 8 th grade (or 9 th grade for cohort 1). The student level predictors (i.e., 
the X, vector) include: standardized scores on Washington's reading and mathematics assessments - 
known as the Washington Assessment of Student Learning (WASL) - when the student was in 6 th grade 
(post-policy cohorts) or 7 th grade (pre-policy cohorts) and indicators for taking the WASL test out-of- 
grade-level 16 and taking a modified version of the WASL 17 ; student's age in May of 8 th grade; and 
indicators for female, race/ethnicity group (Hispanic; Non-Hispanic African American, Asian, Hawaiian or 
Pacific Islander, or Native American or Alaskan Native; and Non-Hispanic and Two or More Races), 
disability status, migrant status, homeless status, "highly capable" status, "transitional bilingual" status, 
language spoken at home other than English, attends public school part-time as a homeschooler or 
private school enrollee, and region (Puget Sound [including King, Pierce, Kitsap, Thurston, and 
Snohomish counties], the remainder of Western Washington [i.e., west of the Cascade Mountains], and 
Eastern Washington). 

We estimate Equation la using a logit specification with middle school fixed effects, MSCE m , to 
account for time-invariant school-level factors that may influence students' signing the pledge. 18 We 
estimate Equation lb using a hierarchical logistic regression (i.e., the logit analog of hierarchical linear 
modeling) with random intercepts. The advantage of the former specification is that it accounts for both 
observable and unobserved time-invariant school level factors. The disadvantage of la over lb is that 
the former does not estimate the way that student sign-up rates are influenced by observable school 
level characteristics. The student's school is defined as the program that the student attended for the 
most consecutive number of days in their 8 th grade year, thus including alternative or secondary 
programs that the student may have attended. When middle school characteristics, S m , are included 
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(Equation lb), the following variables are used: percent of students receiving FRPL, mean standardized 
student score on 6 th grade mathematics WASL (7 th grade for pre-policy cohorts due to data limitations) 
among 8 th grade students in the school, 8 th grade enrollment in fall (divided by 100), whether the school 
has a guidance counselor, and the proximity to college slots (measured as the number of undergraduate 
students at a four-year college within a 50-mile radius 19 ). We expect that schools with higher test scores 
and closer proximity to more college slots will have higher rates of signing the pledge as such schools 
likely have more students who are aware of and interested in attending college. We expect that schools 
with a higher share of students eligible for FRPL will, conditional on mean test scores, have a higher sign- 
up rate as we hypothesize that such schools are more likely to be the target of efforts by community 
organizations. Consistent with the evidence in Hurwitz & Howell (2014), we expect that middle schools 
with guidance counselors will have higher college going rates and will also have more capacity to convey 
information about CBS to students. Finally, we expect that schools with higher enrollment may have 
lower sign-up rates as such large schools may have more difficulty making connections to individual 
students. 

We further estimate versions of la and lb where we replace the outcome with "enrolled in any 
college" (using data from two pre-CBS cohorts). We evaluate whether there are meaningful differences 
in the ^ and S 2 vectors of coefficients using "Enrolled" rather than "Signed". If the coefficients are 
similar, it would indicate, as we would expect, that the types of students who are more prone to attend 
college are also more likely to sign the pledge. Significant differences in the coefficients may also 
provide useful information. For example, given that girls are more likely to enroll in college than boys, 
we expect girls to be more likely to sign the pledge. If we instead find that boys are more likely to sign 
the pledge, it could indicate that: (a) the guidance counselors are doing a good job at getting the 
underrepresented group (boys) to sign the pledge; (b) the current advantage for low-income boys 
signing the pledge could be working to offset their disadvantage relative to girls in college enrollment; 
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and/or (c) efforts focusing on getting low-income girls to sign the pledge could be fruitful given their 


predisposition to attend college. 

The categorization of schools and resulting case selection for our qualitative analysis is based on 
the results from the estimation of Equation lb. We predict each school's 2011-12 sign-up rate 20 based 
on the following Equation 2, where Signed m is the school's predicted sign-up rate, ^indicates the 
average of the school's students' characteristics and S m are the school's characteristics in 2011-12, and 
8 0 , 8 lt and S 2 are estimated coefficients based on data from students in the first three CBS-eligible 
cohorts: 

( 2 ) S igned m =F(8 0 + 8^X m + 8 2 S m ) 

4.2 Data for Quantitative Analysis 

The data we utilize are aggregated by Washington State's Education Research and Data Center 
(ERDC). ERDC maintains individual student level K-12 records for all public school students in the state 
that can be linked to information about enrollment in two- or four-year colleges in Washington State as 
well as those outside the state (through the National Student Clearinghouse). The ERDC data include K- 
12 student information dating back to the 2005-06 school year, providing us data on two cohorts of 
students who did not have the opportunity to receive a CBS scholarship (those who were in 8th grade in 
2005-06 and 2006-07) and three cohorts who were eligible to sign up (those who were in 8 th grade in 
2007-08, 2008-09, or 2009-2010). We dropped from these data students in foster care, foreign exchange 
students, observations with missing ID codes, observations with multiple IDs and irreconcilable 
birthdates, and students who were not identified in a school in 8 th grade. 21 These restrictions reduce the 
number of unique student observations from 443,315 to 414,959. We then restrict the analysis to 
students who are known to be FRPL eligible in 7 th or 8 th grade (or 8 th or 9 th grade for the first post-policy 
cohort), bringing our analytical sample size to 191,205. 

Note that it is not possible with the administrative data made available to us to construct a 
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perfect measure of whether the student is eligible to sign up for the CBS in middle school as we do not 


have information on students who may be income eligible despite not receiving FRPL, the Supplemental 
Nutrition Assistance Program (SNAP), the Food Distribution Program on Indian Reservations (FDPIR), or 
TANF. 22 Fortunately, the share of students who are CBS-eligible, but not known to be FRPL-eligible 
appears to be modest. Specifically, data on all 12 to 14 year olds in families included in the first three 
waves of the 2008 Survey of Income and Program Participation (SIPP) show that the share of SIPP youth 
who meet one of the eligibility criteria for CBS yet who are only eligible due to income (i.e., who are not 
FRPL, SNAP, or TANF recipients or in foster care) is only 13.3%. 23 ' 24 

Nevertheless, the absence of income-only eligible students in our analysis may bias our 
estimates upwards since these students may have a lower responsiveness to the CBS program than the 
students we correctly identify as eligible. There are two reasons for this conclusion. First, such students 
may be more likely to come from families who do not feel comfortable seeking government aid or are 
from families who are generally unaware of available need-based aid programs (as evidenced by the fact 
that they are not enrolled in FRPL, SNAP, FDPIR, or TANF). If so, and if these preferences and/or lack of 
knowledge applied to college financial aid, then this group might be less responsive. Second, based on 
our analysis of SIPP youth, income-only eligible students appear to come from families with lower 
income and higher poverty than students that we correctly identify as eligible. (Those who we identify 
as eligible have higher median family incomes [$30,280 versus $25,711], larger mean family sizes [4.7 
versus 4.1], and higher income-to-poverty threshold ratios [1.31 to 1.24] than those who are foster / 
income-eligible-only, based on these SIPP youth). Such lower income families are likely to have greater 
amounts of support from Pell Grants and State Need Grants, and thus would receive smaller amounts of 
net financial aid support from the CBS program. If they receive relatively less funding from the CBS, they 
might also be expected to be less responsive to the program. 
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As noted above, the CBS program is overseen by the Washington Student Achievement Council 


which "provides strategic planning, oversight, and advocacy to support increased student success and 
higher levels of educational attainment in Washington". 25 WSAC reports substantial success in increasing 
the sign-up rate since the CBS program began. Their calculations, reported in Figure 1, show that the 
sign-up rate was 57% for the first cohort of eligible students and rose to 85% by the 6 th cohort. Their 
website states: 

In 2015, 91% of the Class of 2019 (8th graders whose deadline was June 30, 2015) 
submitted complete applications. This year, 110 districts had sign-up rates of 92% or 
higher. Of these, 77 school districts saw 100% of their eligible students sign up. 26 

Figure 1 suggests both substantial improvement over time in sign-up rates and a situation where 
there is little room for improvement in a large number of school districts. Our estimates, discussed 
below, confirm this improvement over time. However, by using record-level data and a historical 
perspective, we show that the baseline/first-year sign-up rate is in fact lower than the figures reported 
by WSAC, and there remains room for improvement. 

To compute the number of students eligible for CBS, WSAC uses the count of the number of 
FRPL students in 7 th grade as recorded in October of the corresponding school year. 27 The result is an 
early snapshot of eligibility that does not include students who are added to FRPL throughout the 
remainder of the 7 th grade or at any point during 8 th grade. 28 We found that number of FRPL-eligible 
students grows by roughly 20% over the two-year period. 29 This growth in the denominator results in a 
corresponding reduction of the overall sign-up rate. 

To calculate the sign-up rate, we utilize student-level FRPL data, which capture eligibility in both 
7 th and 8 th grades corresponding to the policy's eligibility requirements. In Table 2, we show our 
calculations of the sign-up rate for the first three eligible "Post-Policy" cohorts. In row (A), we find that 
the number of students signing the pledge increased from 14,181 to 18,802 across these three 
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cohorts. 30 By contrast, WSAC reported (as shown in Figure 1) that the number of students signing the 
pledge increased from 15,947 to 20,903 across these same three cohorts. Our counts of the number of 
students who signed the pledge are lower because we do not count pledges from foreign exchange 
students, students in foster care in 7 th or 8 th grade, students that have irreconcilable birthdays across 
observations, or students that did not attend 8 th grade in a Washington school. (Note that these same 
students are not included in our denominator). Also, we do not count pledges for which there was no 
corresponding student in our K-12 database. Next, in row (B), we show that the number of clearly 
eligible students remained fairly stable from 38,651 to 38,478 across the first three cohorts. This 
denominator is substantially higher than the denominator reported by WSAC (i.e., 28,093 to 29,856 as 
shown in Figure 1) for the reasons noted above. We believe the sign-up rates we report represent an 
upper bound given that they do not include students who are made eligible to sign the pledge by virtue 
of participation in SNAP, FDPIR, or TNAF, or who sign the pledge despite not being income eligible. 31 But 
note the sign-up rate we calculate, by dividing (A) by (B) is 36.7% for the first cohort and 48.9% for the 
third cohort, figures that are substantially lower than the 57% and 70% rates reported by WSAC in 
Figure 1, though the increase in our calculated rate over time is very close to that reported by WSAC 
(12.2 percentage points from first to third cohort versus WSAC's report of a 13 percentage point 
change). 

The distinction in the way sign-up rates are calculated may well be important because school 
districts and schools could think they have only a few eligible students who have not signed the CBS 
pledge when in fact there may be many more. 32 Indeed, results from our qualitative work (described 
below) suggest this to be the case. 

It is important to note that there is no auditing mechanism to prevent parents and students 
from signing up and incorrectly claiming to be income-eligible for the CBS. Washington State does not 
have a state income tax system that could be used to verify income. Schools and districts under pressure 
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to meet the implied standard of 100% sign-up have little incentive to question students who have 
completed the forms, including those who may not in fact be eligible. At the same time, the State and 
the schools cannot know when they have reached 100% sign-up because they cannot know what the 
denominator is for any school given the lack of administrative data that is needed to verify eligibility. 

In the last rows of Table 2, we show that there were sizable differences in sign-up rates across 
the three regions of the state, particularly in the first cohort, with Eastern Washington leading and 
Western Washington counties that surround the Puget Sound counties trailing. It is interesting to note 
that, while Eastern Washington had a high sign-up rate for the scholarship program compared to 
Western Washington counties (41.7% versus 28.1% for the first scholarship cohort), both regions have 
similar college enrollment rates (27.1% versus 28.2% for the first scholarship cohort). This heterogeneity 
in sign-up rates suggests the possibility of uneven communication and understanding of the program 
across the state, and provides an argument for the qualitative research that we carry out. 

Table 3 presents the descriptive statistics for our analysis sample, which consists of those 
students who are clearly eligible to sign up. Among eligible students, the share that enrolled in any 
college within 4 years after starting 9th grade increased across the two pre-policy cohorts (from 23.6% 
to 25.7%) and then increased again for the first post-policy cohort to 27.2%. Eligible students also saw 
some improvements in their test scores relative to not-clearly eligible students as can be seen by the 
improvement in their z-scores on the WASL exams. Finally, note that eligible students tend to live closer 
to more undergraduate students than not-clearly eligible students (as indicated by the standardized 
number of undergraduates within 50 miles being greater than zero). 33 

The last two columns of Table 3 show the number of non-missing observations for each variable. 
Approximately 15% of students are missing their own WASL scores, and there is a small amount of 
missingness for school characteristics, which occurs when a middle school's 8 th grade class is 
exceptionally small or is unreported in OSPI report card data. We impute missing variables with a two- 
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step process. First, we use single imputations to impute missing school characteristics linearly based on 


values of observed school characteristics. 34 Second, we use multiple imputation to fill-in all remaining 
school characteristics and WASL scores. We create ten multiply imputed datasets and combine the 
results using Rubin's Rules (Rubin, 1987). 

4.3 Qualitative Data and Analytic Methods 

The goal of our qualitative analysis is to complement the quantitative research on uptake of the 

CBS by providing a deeper understanding of how school-level administrators understand CBS, how 
information is conveyed to students, and what efforts schools are making to get students to sign the 
pledge, as well as to develop hypotheses about why particular schools perform unusually well or poorly 
at stimulating enrollment in the program. As the empirical evidence in Hurwitz and Howell (2014) 
suggests, school administrators, and guidance counselors in particular, may play a vital role in laying the 
groundwork for students to be on a college-ready track and successfully enroll in college. We believe 
such qualitative information is key to understanding the seemingly low CBS take-up rate. 

This report draws upon analyses of data from two sets of semi-structured telephone interviews. 
(Interview protocols are included in the Appendix.) The first set of interviews included the five CBS RO 
and their director on the College Success Foundation staff. The interviews were conducted either 
individually or in a small group between November and December 2015. Interview protocols were 
designed to ensure consistent data collection on critical themes across respondents and to facilitate 
systematic analysis. At the same time, they allowed for unanticipated themes to emerge. A senior 
researcher led interviews while an analyst took notes. Interviews lasted between 60 and 120 minutes. 

Regional officer (RO) interview themes aligned with the core research questions. Key themes 
included: 

• Efforts to inform and engage various stakeholders in the CBS program (schools, students, 
parents, community organizations), 35 
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• Practices to encourage student uptake, 

• Factors limiting student uptake, 

• Evidence that the program is affecting students' behavior, and 

• Factors limiting the program's success. 


After the interviews, the research team distilled notes into analytic themes. We then identified 
areas of agreement, disagreement, and patterns with respect to these themes. Overall, these interviews 
provided a high-level perspective on CBS activities around the state, which was used to inform 
development of the protocol for the second set of interviews with middle school principals and guidance 
counselors. 

For this second round of interviews, we drew a sample of middle schools by first dividing the 
state into the three regions and selecting ten middle schools from each region. For our case selection 
within each region, we aimed to select two middle schools from each of the following five cells 36 , where 
the "School's Predicted Sign-up Rate" is derived from the quantitative analysis: 

School's Actual School's Predicted Characterization 

Sign-up Rate Sign-up Rate of the School 

A) Bottom 20% Bottom 20% Predictably Low Sign-up 

B) Bottom 20% Upper 20% Surprisingly Low Sign-up 

C) 40 th -60 th Percentile 40 th -60 th Percentile Typical School 

D) Upper 20% Bottom 20% Surprisingly High Sign-up 

E) Upper 20% Upper 20% Predictably High Sign-up 

Principal and guidance counselor interviews were conducted between March and August 2016, 
with 30 individual respondents representing 27 schools, including 25 guidance counselors (or other CBS 
program leaders) and 5 principals. 37 Summary information on respondents' distribution across the cells 
described above appears in Table 4. 

Analysis of principal and guidance counselor interviews proceeded in three steps. First, the 
research team developed a database corresponding to the interview protocols, with items organized 
around the research questions and key themes that had emerged from the RO interviews. Second, a 
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trained analyst coded interview notes as they were generated, entering information into the database 


with a senior adviser conducting periodic checks for quality and consistency of the data. Finally, 
researchers extracted and analyzed data across cases on the key questions and themes. 


5. Results 

5.1 Quantitative Findings 

Table 5 reports three model specifications for the likelihood of students signing the pledge. 
Columns (l)-(3) of Table 5 present raw (not regression adjusted) differences in sign-up rates for each 
student characteristic, columns (4)-(6) show the school fixed effects specification (Equation la), and 
columns (7)-(9) the specification with school characteristics (Equation lb). Not surprisingly, there are 
notable differences in the estimated coefficients between the models that do not condition on other 
characteristics (column 1) and those that do (columns 4 and 7). The inclusion of middle school effects 
substantially improves the fit of the model (lowering the Akaike Information Criterion [AIC] from 548 to 
466), but has little impact on many of the student characteristics of interest relative to the results shown 
in column 7 with middle school characteristics. 38 

Some of the groups that are traditionally "advantaged" in terms of educational attainment are 
more likely to sign the pledge. For example, as shown in column (1), we find that females are 7.3 
percentage points more likely to sign up than males. There are, however, some notable exceptions to 
this pattern; for instance, we find that Hispanics, non-Flispanic African Americans, migrants, and 
transitional bilingual students - all sub-groups with lower average college-going propensities 39 - are 
more likely to sign the pledge. 

Column (4) of Table 5 shows the mean marginal effects corresponding to the parameters 
estimated in Equation (la). We find that a one standard deviation increase in student's math test score 
is associated with a 4.1 percentage point increase in the probability of signing the pledge, holding 
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constant all other characteristics. Female students are 6.0 percentage points more likely to sign the 
pledge than otherwise comparable males. Relative to non-Hispanic white students, Hispanics and non- 
Hispanic African Americans, Asians, and multi-racial youth are more likely to sign up, while Native 
American or Alaskan Native youth are less likely to pledge. Finally, of note, students in Eastern 
Washington are 8.1 percentage points more likely to sign up than their peers in the Puget Sound region. 

In columns (7)-(9) of Table 5, we present the results including middle school characteristics 
rather than middle school fixed effects, corresponding to Equation (lb). We find higher sign-up 
likelihood in schools that have higher mean math scores, a higher share of students on FRPL, and more 
undergraduates within 50 miles, controlling for the student's own characteristics. 

In Table 6, we repeat these specifications using as the dependent variable "enrolled in any 
college within 4 years after starting 9th grade." Here, too, we see large differences between the 
coefficients from the model that is not conditioned (column (1)) and that with either middle school fixed 
effects or characteristics (columns (4) and (7) respectively), but little difference between the latter two 
specifications. 

In the first column, we find that the disparities among low-income students mirror those 
typically found when examining all students (e.g, females, whites, Asians, and gifted students are 
substantially more likely to enroll in college "on-time"). When estimating our logit specifications, we 
find a remarkable correspondence between the factors associated with signing the pledge and enrolling 
in college. The correlations between the marginal effects shown in columns (4) and (7) in Tables 5 and 6 
are 0.67 and 0.84 respectively. 

To understand the extent to which these results might inform consideration of enrollment 
disparities within low-income youth, we conduct the following thought experiment. Start with a "typical" 
low-income 7 th grade student who has a 40% chance of signing the pledge and a 25% chance of enrolling 
in college. Given the raw advantage of being female on the likelihood of signing the pledge, 7.27%, we 


20 



could reasonably conclude that this typical low-income student would have a 36.36% chance of signing 


up if male and 43.64% if female. Likewise, given the raw advantage of being female on the likelihood of 
enrolling in college, 9.18%, we could reasonably conclude that this typical low-income student would 
have a 20.41% chance of enrolling in college if male and 29.59% if female. If we assume that signing the 
pledge raises the probability of attending college for a typical student by 3 percentage points, and 
further assume this effect does not vary by gender, 40 the college enrollment rate would rise to 30.90% 
(i.e., 29.59% + 43.64%x3%) for the average low-income female student and to 21.5% (i.e., 20.41% + 
36.36%x3%) for the average low-income male student. Note that the male-female gap in college 
enrollment among low-income students would rise slightly from 9.18% to 9.40% in the presence of the 
College Bound Scholarship. Some simple arithmetic can show that this slight expansion in the disparity 
would be avoided if male signees' likelihood of enrolling in college was increased by 3.6%, while the 
effect for females was held at 3.0%. It is important to note that while the male-female enrollment gap is 
slightly increasing among low-income students, more low-income students are enrolling in college in the 
aggregate than in the absence of the scholarship program - a decidedly positive outcome. 

In Table 7, we repeat this thought experiment for each of the 18 student characteristics. The 
fourth column of Table 7 shows the simulated change in the college enrollment disparity between this 
group and the reference group. The reference group includes all those who do not have the particular 
characteristic; for example, gifted versus non-gifted; Hispanic versus all non-Hispanics; etc. The final 
column of Table 7 shows what level of "effect" of the CBS program on college-going would be needed 
for the reference group to eliminate growth in the college enrollment disparity - these estimates range 
between 2. 2-4.4% depending on the particular variable. 

With respect to school-level sign-up rates, Figure 2 shows the relationship between the school's 
actual sign-up rate and its predicted sign-up rate by region for the 605 schools in Washington State that 
have program-eligible 8 th grade students. A few things merit note here. First, while the actual and 
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predicted rates are correlated, there is substantial deviation (the raw correlation is 0.35). Our qualitative 


analysis (discussed below) allows us to explore explanations for this variation. It furthermore suggests 
that there may be gains to be made by targeting resources towards particular schools with surprisingly 
low sign-up rates. Second, note that the majority of schools have actual sign-up rates in 2011-12 that are 
greater than one would expect based on the behavior of the first three cohorts of students, which is 
consistent with an improving sign-up rate across cohorts. The school that is in the upper-right corner of 
the Puget Sound panel of Figure 2 had 232 eligible students in 2011-12 out of an 8 th grade class of 330, 
yet had high test scores (54% of its eighth graders passed the 8 th grade Measurements of Student 
Progress (MSP) math test). This school will be in the "Predictably High Sign-up" category. In contrast, the 
school that is an outlier in the upper-left corner of the Eastern Washington panel of Figure 2 had all 79 
eighth graders eligible in 2011-12 and only 25% of its students passed the MSP math test. This school 
will be in the "Surprisingly High Sign-up" category. Finally, note that the lack of schools in the upper-left 
and lower-right regions of the Puget Sound panel and lack of schools with high predicted sign-up rates in 
the Remainder of Western Washington will yield few schools in some categories for these regions. 

Panels A and B of Table 8 provide the frequencies of schools by category and region and 
demonstrate that we will need to expand outside some of these categories where there are fewer than 
2 schools in the cell. Panels C and D of Table 8 present the descriptive characteristics of these schools. As 
shown in Panel D, "Surprisingly Low" schools have higher shares of Hispanic and female students, lower 
shares receiving special education, and higher shares passing the 8 th grade MSP math test than 
"Surprisingly High" schools. 
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5.2 Qualitative Findings 
5.2a Regional Officers 

Across the interviews with regional officers (ROs), several themes emerged as potentially 
important for interpreting the quantitative findings about students' program uptake and for informing 
ongoing CBS program development. Respondents reported that schools' success in signing students up 
for the CBS program depends upon (1) district-level "buy-in" and support for the program, coupled with 
a school-level champion who takes "ownership" of the program; (2) counselors or other school staff 
having access to FRPL data in order to target individual students who are eligible for the program; (3) 
guidance counseling staff that are not over-burdened with other responsibilities and have good 
relationships with students; and (4) being in a community or district with a strong college-going culture. 
We discuss each of these issues in turn. 

Importance of district buy-in and school champion 

There was broad agreement across interview respondents that district-level "buy-in" for the 

program is critical to its success. Districts can send a message to school leaders that CBS should be a 

priority. However, respondents described district support as necessary, but insufficient for encouraging 

all eligible students to sign up. The majority of respondents agreed that schools are the most critical 

partner in targeting eligible students and they pointed to the simultaneous need for a "champion" to 

take ownership of the program at the school level to ensure adequate prioritization of the program 

relative to the many activities required of middle school faculty and staff. Ultimately, respondents 

asserted, someone at each school needs to take responsibility for the program's success there. 

In addition to the role of districts and schools, respondents described community organizations 

as sometimes helpful with outreach and promotion, but most felt that such groups would directly sign 

up students only if they have staff within the school, which would limit their ability to help. One RO, 
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however, does rely heavily on community organizations, particularly given the rural nature and weak 


college-going culture of the region. 

Availability of data for targeting eligible students 

Interview respondents described many approaches to working with schools, students, and 

families to encourage sign-up. Among the various efforts, respondents agreed that the most powerful 
approaches are those that target individual eligible students— for example, personalized 
communications versus posters and other promotional materials, or individual sessions with a guidance 
counselor versus group information nights. However, such approaches require adequate information to 
identify and follow-up with individual eligible students. Unfortunately, according to ROs, neither they 
nor their colleagues working in the schools can always get accurate and timely information to do this. 

Although most interview respondents were not aware of the exact nature of the discrepancy 
between the eligibility and sign-up figures discussed above, they were aware of issues with the data 
from WSAC and other sources that might make it difficult for schools to know exactly which students to 
target for sign-up. Specifically, they noted that not all schools are able to access FRPL data on their 
students, either because districts are unable or unwilling to share this student-level data. Even in cases 
where school leaders have access to FRPL data, respondents noted that these might not always be 
accurate, either because students have not signed up for FRPL or because of student mobility. Finally, 
one respondent described how different start dates for the school year can leave some schools and 
districts without the WSAC data at precisely the time when it would be most useful, that is during 
orientation and the first weeks of school. 

The guidance counselor role 

Although there may be variation from school to school in who serves as the CBS program's 
champion, most ROs emphasized the importance of middle school guidance counselors as the key 
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individuals involved in actually getting students to sign up for the program. Indeed, in our interviews 


with school officials, guidance counselors were seen as the program's "strongest champion" in 22 of the 
27 schools. In the five schools that did not identify the counselor as the strongest champion, three did 
not have a guidance counselor, the fourth identified the Counselor's support staff as the main CBS 
administrator, and the fifth was led by the Community in Schools Coordinator, a grant-funded position 
that works closely with the low-income students and other marginalized student groups. 

ROs also noted, however, that heavy workloads can leave some counselors struggling to 
prioritize the program and support its success. Similarly, they described variability across counselors in 
their ability to develop meaningful relationships with students, which they viewed as key to encouraging 
students to sign up. Finally, they described turnover rates among counseling staff as high, noting that 
this could also pose challenges to the program's success. Reflecting the ROs' observations, 10 of the 25 
counselors interviewed named more time, more support staff, or a smaller case load as the most helpful 
action a school could take to help them be a more effective champion for the CBS program. Additionally, 
10 of the 25 counselors had two years or less in their current positions. 

College-going culture and attitudes toward government programs 

Interview respondents pointed to variability in the college-going culture in different regions, 

districts, and schools as another potential reason for variability in sign-up rates. They noted that 
proximity to a college or university often supports the development of a college-going culture, which 
could leave schools in rural areas, in particular, in a more difficult position to promote program success. 
In addition to the relatively straightforward problem of geographic distance from colleges, respondents 
described what might be characterized as a "cultural" distance that is also greater for students on Indian 
reservations and in rural, coastal, and timber communities around the state. In such areas, according to 
respondents, it is not the norm for students to go away to college and there is a pervasive mistrust of 
government that may keep students and families from engaging with the program. 41 Respondents 
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described different sources for this lack of trust, including political and cultural attitudes, immigration 


status and language barriers, and the state legislature's history of failing to fund education programs. 

Opportunities for improvement 

The ROs generally considered the CBS program to be a success, but also noted several areas 
where it could be improved. To improve and maintain high sign-up rates, respondents pointed to two 
opportunities, which correspond to the first two key findings discussed above. First, because district 
leadership and school champions play such important roles, turnover among these positions is a 
concern. Interview respondents emphasized the need for more systemic and systematic approaches, 
where all school faculty and staff have a role to play in encouraging program participation and sign-up 
rates serve as part of a school's evaluation and accountability systems. Second, there was broad 
agreement that stakeholders need easier access to better and more timely data to identify eligible 
students, target them for sign-up, and support them as they move toward college enrollment. 

A final opportunity was identified that could promote students' use of the scholarship after they 
have signed up. Interview respondents emphasized that program sign-up is just the first step. In their 
view, going forward, the CBS program should devote more attention to students' actual uptake of the 
scholarship and success in college. This opportunity is accompanied by many challenges, however. 
Specifically, maintaining students' and families' awareness of the program and encouraging them to 
adequately plan and prepare for college presents a different set of issues from encouraging program 
sign-up. Similarly, if the ultimate goal of the program is college completion, students will require 
additional supports to help them enroll and persist in college. 

5.2b Middle School Guidance Counselors and Principals 

The counselor and principal interviews suggest that middle school guidance counselors view 
their CBS responsibilities as an important part of their work. Nearly all of the respondents (23 out of 25) 
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report that they consider CBS part of their expected job duties, with 16% (4/25) ranking the program as 


having more importance than most of their other duties and two-thirds (17/25) ranking the program as 
having about the same importance as most of their other duties. While holding higher or similar 
importance to their other duties, respondents routinely mentioned the significant amount of time that it 
takes to reach a high student sign-up rate. A third of respondents mentioned heavy time burdens to 
track down signed scholarship forms and nearly half of respondents (10/25) named additional personnel 
support as the main action that a school or district could take to make the respondent a more effective 
program champion. On average, respondents, report spending just over 6% of their annual FTE on the 
program, although, as noted by six respondents, the amount of time they spend on CBS varies 
throughout the year. Time demands on counselors may have a negative effect on program sign-up, as 
CBS ROs asserted, schools where counselors' have too many demands on their time typically have lower 
sign-up rates. 

In line with RO reports, guidance counselors reported using a variety of approaches to promote 
the program and encourage sign-up. The most common activities reported by respondents included 
individual meetings with students (20/25) and parent-teacher conferences (15/25); less common were 
phone calls home (10/25), other group approaches (8/25), other individual approaches (6/25) and 
classroom approaches (5/25); the tactics least commonly reported included school-wide events (3/25), 
placing scholarship forms in orientation packets (2/25) or FRPL application packets (1/25). Our data 
cannot identify causal links between specific activities and sign-up rates, but respondents' reported use 
of multiple activities and emphasis on individual approaches is in line with prior research on the CBS 
program, which identifies as promising practices the use of "multifaceted" outreach and "targeted and 
personalized" outreach (Higgins Terry 2012). It is interesting to note that, while all schools use the fall 
FRPL list to identify eligible students, 17 out of 25 guidance counselors used additional means to identify 
eligible students that were not on the list. These other tactics include sending forms to all students for 
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families to self-identify (10/25), giving applications to any new student (5/25), teachers identifying 
potential students (5/25), giving applications to any foster or homeless students (2/25), and providing 
materials to students who attend a college/career program geared towards low-income or first 
generation college bound students (2/25). This finding suggests that counselors and other program 
administrators recognize that the FRPL list does not capture all eligible students. Indeed, 5 out of the 25 
school counselors recognized that calculated rates were over-estimates of program uptake. 42 

Guidance counselors have an interest in signing-up as many students as possible so as to ensure 
they do not miss any eligible students, and they face little consequence for signing-up ineligible 
students. Half of the guidance counselors interviewed report signing students up without checking their 
eligibility and respondents at ten of the 27 schools report sharing applications with all students. 43 Two 
additional schools previously sent applications to all families but stopped because of complaints by 
ineligible families or because they did not want to promote "false hope." One school asks every student 
to turn in a form and lets WSAC verify the eligibility, while at another school, if a parent asks about 
scholarships, the schools requests that the parent sign the form and sends it to WSAC to verify eligibility. 
Another school signs up every student who ever qualified for FRPL. 

Beyond the work of the counselors themselves, another important component for CBS program 
success— identified both in the literature and by CBS ROs— is district support for the program. A third of 
counselor and principal respondents could identify a district-level "champion" and almost one-fifth 
reported that their district places accountability requirements on schools' CBS sign-up performance. Of 
course, this also shows that a majority of respondents did not report district accountability 
requirements related to CBS sign-up. 

Reflecting on the program's progress and results, respondents were not in close agreement 
about what works, but they did largely concur about primary challenges to the CBS program's success. 
Among the various strategies to support the program, respondents most often identified one-on-one 
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conversations with parents (42%) or students (35%) as the most effective approach. Other strategies 


considered most effective by at least one individual included: classroom approaches, large incentives, 
persistence, and having a WSAC guest speaker come to the school. The greatest challenge to 
encouraging sign-up, identified by more than half of respondents, was getting signed forms back from 
students. Other challenges included unresponsive parents, parents not understanding eligibility 
requirements, the amount of time required for follow-up, HPPA restrictions, and the fact that many 
middle-school students are not terribly future-oriented so college-going is not at the forefront of their 
minds. 

Overall, the vast majority of respondents (77%) believe that the College Bound Scholarship has 
fostered a college-going culture at their school. When asked how it had done this, respondents asserted 
that the program: 

• Has given counselors a reason to start the conversation about college (5) 

• Helps students and/or families see that college is a possibility (4) 

• Works in conjunction with other school-wide college readiness efforts (3) 

Only three respondents stated outright that the program had little to no impact at their school. As one 
of those respondents explained, "our goal is to sign up students, not inspire college." Similarly, two 
respondents reported that the program has had a positive impact on eligible students but has not 
impacted school-wide culture and another asserted that the program is mostly helping those students 
who are already motivated to attend college. 


6. Conclusion 

Early commitment scholarship pledge programs are relatively new so it is not surprising that we 
know relatively little about program effects, and almost nothing about students' decisions to sign up. 
This is an important gap in the literature since this type of pledge program can only help students if they 
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choose to participate. In this paper we provide the first evidence of the factors that predict the 
likelihood of students signing Washington's College Bound Scholarship. 

We document that while the state has made considerable progress in increasing the number of 
eligible middle school students signing the pledge, sign-up rates are still far below 100% in most school 
districts. This finding conflicts with state reports, suggesting near universal sign-up rates in many 
districts, which are based on incomplete data on eligible students. The difference between these state 
reports and the proportion of eligible students that we observe to have actually signed up may be 
important as ROs and guidance counselors working to encourage both CBS sign up and college-going 
might allocate their efforts differently if they received more accurate information about sign up rates. 

Perhaps unsurprisingly, the individual student characteristics that are associated with signing 
the pledge are closely aligned with the characteristics that predict whether low-income students go on 
to 4-year colleges. High achieving students, for instance, are both more likely to sign the pledge and are 
more likely to go to college. This correspondence suggests that sign-up disparities may modestly 
increase college enrollment disparities among the targeted low-income students, even though it may 
narrow college enrollment disparities between low- and higher-income students. Also not surprisingly, 
there is a positive correlation between predicted school level sign-up rates and actual sign-up rates, but 
the correlation, 0.35, is not overwhelmingly high. This, combined with the fact that schools have lower 
sign-up rates than is reflected in public reports, suggests it may be beneficial to target resources 
towards encouraging student sign-ups at schools with surprisingly low sign-up rates. 

Notes 

1 The state regards this as a need-based scholarship (WSAC, 2016), though some may view it as both a need- and merit-based 
scholarship given that students must maintain a 2.0 grade point average in middle and high school in order to be eligible to 
receive scholarship money. For the first year of the program the pledge was available to 9 th graders as well. 

2 For an overview of changes in postsecondary enrollments and the magnitudes of attainment gaps between sub-populations, 
see Increasing Access to College: Extending Possibilities for All Students, edited by Tierney and Fiagedorn (2002). 

3 WSAC is a cabinet-level agency. For more information on the responsibilities of WSAC, see http://www.wsac.wa.gov/what-we- 
do. 

4 These "early commitment" programs are similar to merit scholarship programs that are available in a number of states 
(Georgia's HOPE Scholarship Program is particularly well-known), in that they require students to earn a certain high school 
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GPA to be eligible for receipt of the funds, but they differ from merit scholarship programs in that they are income-contingent 
(i.e., available only to low-income students) and require the signing of a pledge in the early high school grades. 

5 Income-eligibility is reassessed in every year of postsecondary schooling and students could lose CBS scholarship funds if 
family income rises above the specified threshold. 

6 If attending a private institution, the student will be granted the maximum amount they would have been awarded if they 
attended a public institution. Students can only use CBS funds at eligible state aid participating private institutions, for more 
detail on this, see http://www.readvsetgrad.org/eligible-institutions 

7 Note that for the first cohort, for a family of four, 185 percent of the poverty line equaled $39,220 in 2008. 

8 The language surrounding CBS implies a contractual bond between the student and the state. The "College Bound Scholarship 
Program... promises annual college tuition and a small book allowance" [ http://www.wsac.wa.gov/sites/default/files/2011- 

12 Q&A.pdf , emphasis added]. Moreover, given that the student is required to do well in school, be a good citizen, and not 
commit a felony, it appears that it would be politically hard to break the promise if the student does these things. As State 
Representative Reuven Carlyle noted, the state has "a moral responsibility to fund [the CBS]. There's no way we can break that 
social contract" (Long, 2012). As a result, these types of pledge programs may bind future legislatures to fund the programs 
given the promise of funding. These kinds of pledge policies may be appealing to legislatures given their transparency to 
students and the ability of current legislatures to bind the actions of future legislators. 

9 The maximum award is based on tuition and service and activity fees for 15 credits at a public institution, plus book allowance. 
For 2014-15, this amount was $11,904 plus a $500 book allowance. 

10 The Wisconsin Covenant is not included in this summary as eligibility for it is not restricted to economically disadvantaged 
students. Colorado's Collegelnvest Early Achievers Scholarship is not included as the program was closed in 2010. California's 
"Early Commitment to College" and "SOAR Virginia" are not included in this summary because they are not available in all 
schools in the state and programmatic details vary across districts. 

11 In 2013-14, 80.6% of Washington students enrolled in the fall of 12 th grade had a 2.0 or higher GPA. 

12 Regional Officers are hired through Washington College Access Network, a subsidiary of the College Success Foundation, who 
holds a contract with OSPI for program outreach activities. The research team interviewed all ROs working at the time data 
were collected. 

13 The gap in enrollment in a postsecondary institution in Washington between students eligible and not eligible for FRPL for 
2004-05 high school graduates was about 20 percentage points. 

14 A previous study performed by the BERC group for the Gates Foundation explored the stratification in college readiness, 
enrollment, and persistence among pledged CBS students in the first scholarship cohort (Baker et al., 2013). They do not, 
however, touch on sign-up rates or sign-up rate variation that occurs across the state. 

15 For students who attended more than one school in 8th grade, we used the school attended for the most days. 

16 For example, a 6 th grader taking the test given to 7 th graders. WASL scores are set to missing for these students and then 
imputed as discussed below. For 2008-09, observations did not have reporting grades and for these the student's test grade 
was assumed to be the student's grade level. 

17 Mostly given to students with disabilities. 

18 The "incidental parameters" problem that occurs when using fixed effects in a logit model with panel data is not a concern 
for us as the number of students at each middle school is typically far above the numbers that would yield an incidental 
parameters problem. In similar situations, Cameron and Trivedi (2005) prefer the term "cluster effects" rather than the more 
commonly used term "fixed effects", as "fixed effects" are more appropriately used in the context of panel data containing 
multiple observations of outcomes for a single individual, whereas a cluster effect refers to a common effect occurring for 
individuals in a cluster, in this case the school. Nonetheless, we follow convention here in using the more familiar "fixed 
effects" terminology. 

19 We also used number of undergraduates within 10- or 25-miles of the middle school, and these produced qualitatively similar 
results. See Authors (2016) for more information about the effect of college proximity on college enrollment decisions, as well 
as information on the spatial distribution of Washington's colleges and how that corresponds to the locations of students. 

20 2011-12 is the most recent year for which we have data to compute the school's actual sign-up rate. 

21 The CBS automatically enrolls all foster care students into the scholarship if they are in grades 7-12, thus signing the pledge is 
not a relevant choice for this group. Foreign exchange students (i.e., those in formal exchange programs, not including 
undocumented immigrants) are dropped from the analysis as they are not eligible for the program. Observations with missing 
ID codes reflect pledges that could not be connected to a student in our administrative data. Students with irreconcilable 
birthdates reflect multiple students who, mistakenly, share an ID code and could not be disentangled. Students who were not 
identified in a school in 8 th grade were dropped because they could not be included in our regression analysis that included 
school characteristics or school fixed effects. 

22 Washington does not have a state income tax so we cannot identify eligibility directly from income tax records. But by 2008- 
09, all school districts in the U.S. were required by the 2004 Child Nutrition and WIC Reauthorization Act to "directly certify" 
recipients of SNAP and FDPIR as eligible for free meals under the National School Lunch Program. Thus, all SNAP and FDPIR 
recipients should be coded as a FRPL-eligible in our administrative data. In Washington in 2007-08, 76 percent of children in 
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SNAP households were directly certified for free school meals (USDA, 2008). Washington began direct certification of children 
in TANF households in 2003-04 (Neuberger, 2006). 

23 This figure is based on 3,245 SIPP youth, aged 12-14, who were CBS eligible. If we restrict the analysis to Washington youth 
(only 93 observations), we find a comparable rate of youth eligible for CBS based solely on family income (17.7 percent), which 
is not significantly different than the full sample given the small sample size. 

24 Recipients of the FDPIR are directly certified as eligible for free lunches, but SIPP does not collect data on FDPIR participation. 
Since we will capture these youth as FRPL-eligible from school administrative data, our estimate of the fraction that we will 
miss, 13.3 percent, is an upper-bound estimate. Nationally (and in Washington) we estimate (based on data in Usher, Shanklin, 
& Wildfire [1990], Snyder & Dillow [2011], and USDA [2012]) that 0.05 percent (0.10 percent in Washington) of 8 th grade 
students participate in FDPIR. 

25 Source: http://www.wsac.wa.gov/ , accessed on February 19, 2016. 

26 Source: http://www.wsac.wa.gov/college-bound . accessed on February 19, 2016. 

27 Source: Personal communication from Rachelle Sharpe, Ph.D., Senior Director of Student Financial Aid and Support Services, 
Washington Student Achievement Council, December 3, 2015 

28 There were 30,521 7th graders denoted FRPL eligible in October 2005-06, while during the remainder of that school year, an 
additional 3,540 7th graders were denoted FRPL eligible after October (having not been eligible in October), and in the 
following school year an additional 5,238 students were denoted as eligible in 8th grade that had not been eligible at any point 
the year before. 

29 Additionally, the WSAC denominator misses all students who are income-eligible, but not FRPL, SNAP, or TANF recipients, or 
in foster care. 

30 Note that a small number of students from the "Pre-Policy" cohorts signed-up. These students may include those who were 
retained such that they became part of a subsequent "Post-Policy" cohort. We define a student's cohort given the first cohort in 
which they are observed - thus retained students are counted as belonging to their pre-retention cohort. 

31 ln Table 2 we also report a second definition of the sign-up rate, the number who signed the pledge and we identify as 
"clearly eligible" divided by the number we identify as being "clearly eligible" to participate. This lower sign-up rate ranges from 
33.7% to 45.5% across the three cohorts. 

32 See, for instance, http://www.wsac.wa.gov/sites/default/files/2015.10.23.CBS.School.Districts.pdf . Schools are able to view 
whether their students have signed the pledge and thus can monitor sign-up rates (Personal communication from Rachelle 
Sharpe, March 7, 2016); we are unsure of the extent to which they do so. 

33 A couple of other points of note. The 48-49% female share of these eligible students is the same as the general population of 
Washington middle school students. In 2007-2008, there was a large jump in state appropriation funding for highly capable 
programs, which explains the corresponding jump in the share of clearly eligible students in this program. Finally, the sign-up 
rate for "pre-policy" students is not zero as some small share of these students became eligible for the program as a result of 
being retained a grade. 

34 A middle school's average 6 th grade test score (z-score) for their 8 th grade class is calculated from students' individual test z- 
score. If a student's 6 th grade test score is missing, it is filled in with the z-score from the test that is closest in time to the 
missing score (i.e. 5 th grade or 7 th grade z-score if missing 6 th grade score), with priority given to the earlier test score. If a 
middle school's average 6 th grade test score is still missing, it is imputed using the steps listed above. 

35 Community organizations have been engaged by the state to play an active role in helping increase sign-up rates (Power, 
2011 ). 

36 We excluded schools with fewer than 25 8 th graders from this analysis. Schools with small enrollments may have low or high 
rates of sign-up for atypical reasons and their high or low sign-up rates in a particular year may be ephemeral. This led us to 
drop 30.5% of middle schools enrolling 2.2% of students. When there were more than two middle schools in a region-cell, we 
randomly selected two middle schools (with probabilities of selection being set to be proportional to the number of eligible 8 th 
graders in the school). If there were no middle schools in the region-cell, we selected the middle school within that region that 
was closest to the characterization of the cell. 

37 We also interviewed a college readiness coordinator identified through professional contacts. Information from this interview 
is not included in descriptive statistics from the interview sample but is included in discussion of qualitative themes. 

38 The F-statistic testing the null hypothesis that the addition of the school fixed effects are jointly zero is 16.6 (p-value=0.000). 

A few of the student coefficients do change significantly in magnitude when we move from a school fixed effects specification 
to a school characteristics specification, such as the coefficients on receiving bilingual services and attending public school part 
time, but these are very small student sub-groups. 

39 In cohort 1, 24.0% of low-income Hispanics, 28.4% of low-income African-Americans, 23.9% of low-income migrant students, 
and 24.6% of low-income transitional bilingual students enrolled in college 4 years after 9 th grade. This compares to each 
subgroups' scholarship average sign-up of 41.1%, 38.3%, 50.1%, and 42.6% respectively. 

40 Our subsequent papers will attempt to estimate the causal effect of signing the pledge. This 3-percentage point effect is 
completely hypothetical and used only for illustration. 
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41 They noted that such areas, which are largely in Eastern Washington, are politically more conservative and libertarian than 
more urban areas like Seattle and Western Washington. Yet, our quantitative findings, discussed previously, show that students 
from Eastern counties are, all else equal, more likely to sign a pledge than their Western counterparts. 

42 Although one counselor believed the WSAC sign-up rates were "underestimates." 

43 Total number of schools includes two schools in which the principal, but not the guidance counselor, was interviewed. 
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Table 1: Differences Between Washington State's Program and Other States' Programs 



Indiana 21 st Century 
Scholars Program 

Oklahoma Promise 

Washington College Bound 
Scholarship 

Year Started 

When the Student Signs the Pledge 

1990 

1992 

2007 

Time of commitment 

Income Requirement When Pledge is Signed? 

6th, 7th or 8th grade 

No (Foster care); 
otherwise. Yes (V aries 
by household size, 
equivalent to eligibility 
for FRPL.) 

8th, 9th and 10th grade 
Yes (Family income of 
$50,000 or less at 
commitment. Special 
income provisions 
apply to children 
adopted from certain 
court-ordered custody 
and children in the 
custody of court- 
appointed legal 
guardians) 

7th, 8th grade 

No (Identified by state as 
eligible for FRPL, family 
receives basic food/TANF 
benefits, or currently in foster 
care or a dependent of the state); 
otherwise, Yes (Varies by 
household size, equivalent to 
eligibility for FRPL.) 

When the Student Goes to College 




Income Requirement To Qualify for 
Scholarship? 

No (Class of 2015 and 
Earlier); Yes (Class of 
2018 and Later); 
Depends on when 
enrolled in the program 
(Class of20 16, 2017) 

Yes, family income of 
$100,000 or less at the 
time the student begins 
college. 

Yes, less than 65% of the state’s 
Median Family Income ($53,000 
fora family of four in 2012-13) 

GPA Threshold 

2.0 (Class of 2014 and 
earlier); 2.5 (Class of 
2015 and later) 

2.5 

2 

College-bound coursework requirement? 

Yes 

Yes 

No 

Requires the student to earn a specific type of 
diploma? 

No (Class of 2016 and 
Earlier); Yes, a "Core 
40" diploma (Class of 
2017 and Later) 

No 

No 

Other Curricular Requirements 

No (Class of 2016 and 
Earlier); Yes — 
Completion of "Scholar 
Success Program" 
(Class of 2017 and 
Later) 

No 

No 

Guaranteed full tuition? 

Yes (Class of 20 15 and 
Earlier); No (Class of 
2018 and Later); 
Depends on when 
enrolled in the program 
(Class of20 16, 2017) 

Yes, frill tuition at 
public institutions and 
a portion of tuition at 
private institutions. 

Yes, plus a book allowance. 


Sources: Hamisch (2009), Heller (2006), Indiana Division of Student Financial Aid (2013a, 2013b, 2013c), Oklahoma State Regents for 
Higher Education (2013a, 2013b), and Washington Student Achievement Council (2013a, 2013b) 


Table 2: Sign-up Rates 



Expected HS Graduation Y ear 


(A) Number who signed the pledge 

(B) Number who we identify as "clearly eligible" 

(C) Number who signed the pledge and we identify as 
"clearly eligible" 

Sign-up Rate 1: (A)/(B) 

Sign-up Rate 2: (C)/(B) 

Sign-up Rate 2 for Puget Sound Counties 

Sign-up Rate 2 for Other Western Washington Counties 

Sign-up Rate 2 for Eastern Washington 


2010 

2011 

2012 

2013 

2014 

Pre -Policy 


Post-Policy 

7th grade 
in 2004- 
OS or 8th 
grade in 
2005-06 

7th grade 
in 2005- 
06 or 8th 
grade in 
2006-07 

8th 

grade in 

2007- 08 
or 9th 

grade in 

2008- 09 

7th 

grade in 

2007- 08 
or 8th 

grade in 

2008- 09 

7th grade 
in 2008- 
09 or 8th 
grade in 
2009-10 

25 

235 

14,181 

15,145 

18,802 

39,156 

37,410 

38,651 

37,510 

38,478 

24 

217 

13,038 

13,943 

17,523 

0.1% 

0.6% 

36.7% 

40.4% 

48.9% 

0.1% 

0.6% 

33.7% 

37.2% 

45.5% 

0.1% 

0.7% 

31.0% 

34.5% 

45.4% 

0.1% 

0.3% 

28.1% 

32.8% 

42.1% 

0.0% 

0.6% 

41.7% 

44.5% 

48.4% 


Note: "Clearly eligible" defined as a student that was marked as eligible for Free and Reduced Lunch Program at any point 
during their 7th or 8th grade year (8th or 9th grade for the first Post-Policy cohort). 



Table 3: Descriptive Statistics for Analysis Sample 


Number of Observations 
in Pooled Sample with 

Pre-imputation Mean and Standard Deviation Non-Missing Data 



Pre-Policy 

7 th grade 7 th grade 

in 2004- in 2005- 

OS or 8th 06 or 8th 

grade in grade in 

2005-06 2006-07 

8th grade 
in 2007- 
OS or 9th 
grade in 
2008-09 

Post-Policy 
7th grade 
in 2007- 
OS or 8th 
grade in 
2008-09 

7th grade 
in 2008- 
09 or 8th 
grade in 
2009-10 

Pre- 

Policy 

(Two 

Cohorts 

Pooled) 

Post- 

Policy 

(Three 

Cohorts 

Pooled) 

Dependent Variable 








Signed the Pledge 

0.1% 

0.6% 

33.7% 

37.2% 

45.5% 

76,566 

114,639 

Enrolled in any college within 4 years after 

23.6% 

25.7% 

27.2% 

Incomplete 

76,566 

114,639 

starting 9th grade 








Student Characteristics 








Reading WASL 

-0.38 

-0.36 

-0.32 

-0.32 

-0.30 

65,962 

96,914 

(standardized within test grade, test type, and 
cohort) 

(0.96) 

(0.95) 

(1.00) 

(0.99) 

(0.98) 



Math WASL 

-0.4 

-0.39 

-0.38 

-0.39 

-0.35 

66,040 

96,959 

(standardized within test grade, test type, and 
cohort) 

(0.93) 

(0.94) 

(0.94) 

(0.95) 

(0.93) 



Took WASL out-of-grade-level 








Took a modified version of WASL 

2.6% 

5.0% 

6.1% 

7.0% 

5.9% 

76,566 

114,639 

Age in 8th grade 

14.4 

14.4 

14.4 

14.4 

14.4 

76,566 

114,639 


(0.8) 

(0.5) 

(0.5) 

(0.5) 

(0.5) 



Female 

48.0% 

48.7% 

48.4% 

48.7% 

48.4% 

76,566 

114,639 

Hispanic 

25.6% 

28.4% 

30.2% 

31.9% 

31.4% 

76,566 

114,639 

Non-Hispanic African American 

7.4% 

7.0% 

6.6% 

6.5% 

6.1% 

76,566 

114,639 

Non-Hispanic Asian 

5.9% 

5.7% 

5.7% 

5.6% 

5.4% 

76,566 

114,639 

Non-Hispanic Hawaiian or Pacific Islander 

0.1% 

0.2% 

0.2% 

0.3% 

0.3% 

76,566 

1 14,639 

Non-Hispanic Native American or Alaskan 

3.2% 

2.3% 

2.0% 

2.0% 

1.8% 

76,566 

114,639 

Native 








Non-Hispanic and More Than One Race 

7.7% 

10.1% 

10.3% 

10.4% 

10.8% 

76,566 

114,639 

Disability 

20.2% 

20.4% 

21.6% 

23.0% 

24.1% 

76,566 

114,639 

Migrant 

7.3% 

7.9% 

8.4% 

9.0% 

8.6% 

76,566 

1 14,639 

Homeless 

8.0% 

10.3% 

11.5% 

12.6% 

13.6% 

76,566 

1 14,639 

Gifted (“highly capable”) 

2.6% 

3.9% 

3.9% 

6.1% 

6.2% 

76,566 

114,639 

Receives bilingual services ("transitional 

13.6% 

16.0% 

18.5% 

21.7% 

23.2% 

76,566 

114,639 

bilingual”) 








Language spoken at home other than English 

22.9% 

25.8% 

28.1% 

30.5% 

31.3% 

76,566 

114,639 

Attends public school part-time 

0.3% 

0.3% 

0.6% 

0.4% 

0.6% 

76,566 

114,639 

Attended 8th grade in Puget Sound Counties 

48.7% 

50.1% 

49.6% 

49.4% 

49.3% 

76,566 

1 14,639 

Attended 8th grade in Other Western 

19.6% 

19.1% 

19.5% 

19.9% 

20.3% 

76,566 

114,639 

Washington Counties 








Attended 8th grade in Eastern Washington 

31.7% 

30.8% 

30.9% 

30.7% 

30.5% 

76,566 

114,639 

Middle School Characteristics 








Average Math WASL 

-0.20 

-0.19 

-0.16 

-0.17 

-0.16 

76,471 

114,491 

(standardized across schools within cohorts) 

(0.36) 

(0.35) 

(0.34) 

(0.35) 

(0.33) 



8th Grade fall enrollment 

242 

238 

235 

234 

233 

74,755 

112,953 


(107) 

(102) 

(106) 

(107) 

(105) 



Percent of student body on FRPL 

47.57 

47.5 

48.44 

50.51 

51.73 

75,752 

114,215 


(21.68) 

(21.41) 

(21.67) 

(20.75) 

(21.12) 



Undergrad enrollment within a 50-mile radius 

0.1 

0.15 

0.15 

0.15 

0.15 

76,302 

114,376 

(standardized across schools within cohorts) 

(1.01) 

(1.01) 

(1.00) 

(1.00) 

(1.00) 



Has a guidance counselor 

90.60% 

91.90% 

93.40% 

93.80% 

92.70% 

76,566 

1 14,639 


Note: Standard deviations are in parentheses. Students are eligible to sign the pledge in 8th or 9th grade for Cohort 1 and 7th or 8th grade for subsequent cohorts. 
WASL scores are based on 6th grade administration for post-policy cohorts and 7th grade for pre-policy cohorts. 



Table 4: Respondent Sample by Region and Predicted Sign-up Rate Cell 



Remainder of 

Western WA 

Puget Sound 

Eastern Region 

TOTAL 

Surprisingly low 

2 

2 

2 

6 

Predictably low 

3 

1 

2 

6 

Typical school 

2 

2 

2 

6 

Predictably high 

2 

2 

2 

6 

Surprisingly high 

1 

2 

0 

3 

TOTAL 

10 

9 

8 

27 







Table 5: Marginal Effects of Student and School Characteristics on the Likelihood of Signing the Pledge 

(1) (2) (3) (4) (5) (6) (7) (8) (9) 

Y = Signed the Pledge 

Estimated on Post-Policy Cohorts 

Raw Differences (i.e Logit Model with Mixed Effects Logit 

Not Conditioned on Middle School Fixed Model with School 
Other Characteristics) Effects Characteristics 

Student Characteristics 


Math WASL (Standardized) 

.049 

(.002) 

*** 

.041 

(.004) 

*** 

.043 

(.003) 

*** 

Reading WASL (Standardized) 

.050 

(.002) 

*** 

.031 

(.003) 

*** 

.028 

(.003) 

*** 

Took WASL out-of-grade-level 

-.049 

(.015) 

*** 

.068 

(.022) 

** 

.068 

(.017) 

*** 

Took a modified version of WASL 

-.080 

(.006) 

*** 

-.032 

(.012) 

** 

-.040 

(.008) 

*** 

Age in 8th grade 

-.035 

(.003) 

*** 

-.028 

(.003) 

*** 

-.021 

(.002) 

*** 

Female 

.073 

(.003) 

*** 

.060 

(.003) 

*** 

.055 

(.003) 

*** 

Hispanic 

.090 

(.003) 

*** 

.056 

(.012) 

*** 

.015 

(.005) 

** 

Non-Hispanic African American 

.061 

(.006) 

*** 

.148 

(.011) 

*** 

.078 

(.008) 

*** 

Non-Hispanic Asian 

.098 

(.006) 

*** 

.104 

(.012) 

*** 

.049 

(.008) 

*** 

Non-Hispanic Hawaiian or Pacific Islander 

-.104 

(.027) 

*** 

-.039 

(.029) 


-.070 

(.024) 

** 

Non-Hispanic Native American or Alaskan Native 

-.120 

(.010) 

*** 

-.050 

(.019) 

** 

-.057 

(.012) 

*** 

Non-Hispanic and More Than One Race 

-.019 

(.005) 

*** 

.049 

(.007) 

*** 

.021 

(.005) 

*** 

Disability 

-.090 

(.003) 

*** 

-.020 

(.005) 

*** 

-.012 

(.004) 

** 

Migrant 

.150 

(.005) 

*** 

.046 

(.017) 

** 

.030 

(.008) 

*** 

Homeless 

-.026 

(.004) 

*** 

.000 

(0.006) 


-.013 

(.004) 

** 

Gifted (“highly capable”) 

.129 

(.006) 


.085 

(.014) 

*** 

.079 

(.009) 

*** 

Receives bilingual services ("transitional bilingual”) 

.115 

(.004) 

*** 

.065 

(.013) 

*** 

.033 

(.006) 

*** 

Language spoken at home other than English 

.115 

(.003) 

*** 

.042 

(.014) 

** 

.047 

(.006) 

*** 

Attends public school part-time 

-.100 

(.020) 

*** 

-.064 

(.022) 

** 

.005 

(.024) 


Attended 8th grade in Remainder of Western WA 

-.055 

(.004) 

*** 

.004 

(.021) 


.030 

(.022) 


Attended 8th grade in Eastern Washington 

.087 

(.003) 

*** 

.081 

(.022) 

*** 

.050 

(.023) 

* 


Middle School Characteristics 


Average Math WASL (Standardized) 

.147 

(.021) *** 

8th grade fall enrollment 

-.009 

(.oil) 

Percent of student body on FRPL 

.004 

(.001) *** 

Undergrad enrollment within a 50-mile radius (Std.) 

.045 

(.016) ** 

Has a guidance counselor 

.027 

(.021) 


Number of observations 114,639 

Note: Standard deviations are in parentheses. WASL scores are based on 6th grade administration for post-policy cohorts and 7th 
grade for pre -policy cohorts. "Raw Differences" are computed by an ordinary least square regression of the outcome on the student 
characteristic (with no other controls). 



Table 6: Marginal Effects of Student and School Characteristics on the Likelihood of Enrolling in College On-Time 


(1) (2) (3) (4) (5) (6) (7) (8) (9) 

Y = Enrolled in any college within 4 years after starting 9th grade 

Estimated on Pret-Policy Cohorts 

Raw Differences (i.e Logit Model with Mixed Effects Logit 

Not Conditioned on Middle School Fixed Model with School 
Other Characteristics) Effects Characteristics 

Student Characteristics 


Math WASL (Standardized) 

.157 

(.002) 

*** 

.104 

(.004) 

*** 

.100 

(.004) 

*** 

Reading WASL (Standardized) 

.145 

(.002) 

*** 

.078 

(.003) 

*** 

.075 

(.003) 

*** 

Took WASL out-of-grade-level 

-.134 

(.013) 

*** 

.082 

(.026) 

** 

.072 

(.024) 

*** 

Took a modified version of WASL 

-.144 

(.008) 

*** 

-.025 

(.014) 

** 

-.021 

(.014) 

*** 

Age in 8th grade 

-.045 

(.002) 

*** 

-.043 

(.003) 

*** 

-.041 

(.003) 

*** 

Female 

.092 

(.003) 

*** 

.063 

(.003) 

*** 

.063 

(.003) 

*** 

Hispanic 

-.032 

(.004) 

*** 

-.029 

(.007) 

*** 

-.024 

(.005) 

** 

Non-Hispanic African American 

-.006 

(.006) 

*** 

.061 

(.009) 

*** 

.075 

(.008) 

*** 

Non-Hispanic Asian 

.225 

(.007) 

*** 

.148 

(.012) 

*** 

.142 

(.010) 

*** 

Non-Hispanic Hawaiian or Pacific Islander 

-.141 

(.044) 

*** 

-.127 

(.037) 


-.094 

(.045) 

** 

Non-Hispanic Native American or Alaskan Native 

-.104 

(.009) 

*** 

-.076 

(.014) 

** 

-.066 

(.012) 

*** 

Non-Hispanic and More Than One Race 

-.064 

(.005) 

*** 

-.030 

(.006) 

*** 

-.025 

(.006) 

*** 

Disability 

-.169 

(.004) 

*** 

-.051 

(.005) 

*** 

-.055 

(.005) 

** 

Migrant 

-.004 

(.006) 

*** 

.009 

(.011) 

** 

.011 

(.008) 

*** 

Homeless 

-.136 

(.005) 

*** 

-.101 

(.006) 


-.101 

(.006) 

** 

Gifted ("highly capable”) 

.336 

(.009) 

*** 

.172 

(.012) 

*** 

.176 

(.012) 

*** 

Receives bilingual services ("transitional bilingual”) 

-.031 

(.004) 

*** 

.001 

(.007) 

*** 

.001 

(.007) 

*** 

Language spoken at home other than English 

.039 

(.004) 

*** 

.057 

(.008) 

** 

.056 

(.007) 

*** 

Attends public school part-time 

-.047 

(.030) 

*** 

.013 

(.038) 

** 

.026 

(.037) 


Attended 8th grade in Remainder of Western WA 

-.004 

(.004) 

*** 

.023 

(.009) 


.019 

(.012) 


Attended 8th grade in Eastern Washington 

.021 

(.003) 

*** 

.044 

(.010) 

*** 

.040 

(.013) 

* 


Middle School Characteristics 

Averagage Math WASL (Standardized) 

8th grade fall enrollment 
Percent of student body on FRPL 
Undergrad enrollment within a 50-mile radius (Std.) 
Has a guidance counselor 


.141 (.025) *** 

-.010 (.006) 

.000 (. 000 ) * 
-.003 (.009) 

.030 (.012) * 


Number of observations 


76,556 


Note: Standard deviations are in parentheses. WASL scores are based on 6th grade administration for post-policy cohorts and 7th 
grade for pre -policy cohorts. "Raw Differences" are computed by an ordinary least square regression of the outcome on the student 
characteristic (with no other controls). 



Table 7: Simulated Effect of Sign-up Disparities on College Enrollment Disparities, Assuming Sign-up Raises College 
Enrollment by 3% 



(1) 

(2) 

(3) 

(4) 

(5) 


Raw 

Raw Pre- 

Simulated 

Change in 

What Would the Effect of 


Sign-up 

Policy 

Post-Policy 

College 

Sign-up on College Enrollment 


Disparity 

College 

College 

Enrollment 

for the Reference Group Need 



Enrollment 

Enrollment 

Disparity 

to be to Hold the College 



Disparity 

Disparity 


Enrollment Disparity Constant 
(Holding Effect on This Group 






at 3%)? 

Advantaged Groups Whose College 

Enrollment Advantage Will Likely Increase 






Gifted (“highly capable”) 

0.129 

0.336 

0.339 

0.004 

4.2% 

Language spoken at home other than 

English 

0.115 

0.039 

0.042 

0.003 

4.0% 

Non-Hispanic Asian 

0.098 

0.225 

0.228 

0.003 

3.8% 

Attended 8th grade in Eastern Washington 

0.087 

0.021 

0.024 

0.003 

3.7% 

Female 

0.073 

0.092 

0.092 

0.000 

3.6% 

Disadvantaged Groups Whose College 
Enrollment Disadvantage Will Likely Increase 






Non-Hispanic Native American or Alaskan 
Native 

-0.120 

-0.104 

-0.108 

-0.004 

2.2% 

Non-Hispanic Hawaiian or Pacific Islander 

-0.104 

-0.141 

-0.144 

-0.003 

2.3% 

Attends public school part-time 

-0.100 

-0.047 

-0.050 

-0.003 

2.3% 

Disability 

-0.090 

-0.169 

-0.172 

-0.003 

2.4% 

Took a modified version of WASL 

-0.080 

-0.144 

-0.147 

-0.002 

2.5% 

Attended 8th grade in Remainder of 

Western WA 

-0.055 

-0.004 

-0.005 

-0.002 

2.6% 

Took WASL out-of-grade- level 

-0.049 

-0.134 

-0.135 

-0.001 

2.7% 

Homeless 

-0.026 

-0.136 

-0.137 

-0.001 

2.8% 

Non-Hispanic and More Than One Race 

-0.019 

-0.064 

-0.064 

-0.001 

2.9% 

Disadvantaged Groups Whose College 
Enrollment Disadvantage Will Likely 

Decrease 






Migrant 

0.150 

-0.004 

0.000 

0.004 

4.4% 

Receives bilingual services ("transitional 
bilingual”) 

0.115 

-0.031 

-0.027 

0.003 

4.0% 

Hispanic 

0.090 

-0.032 

-0.029 

0.003 

3.8% 

Non-Hispanic African American 

0.061 

-0.006 

-0.004 

0.002 

3.5% 


Table 8: Frequencies and Descriptive Characteristics of Schools by Actual vs. Predicted Sign-Up Rates 


Panel A: Category Counts by Region 



School's Actual Sign- 
Up Rate 

School's Predicted 
Sign-Up Rate 

Category 


Puget Sound 
Area 

Remainder 
of Western 
Washington 

Eastern 

Washington 

TOTAL 

Bottom 20% 

Bottom 20% 

Predictably low 


41 

29 

42 

112 

Bottom 20% 

Upper 20% 

Surprisingly low 


9 

5 

4 

18 

40th-60th Percentile 

40th-60th Percentile 

Typical School 


8 

8 

4 

20 

Upper 20% 

Bottom 20% 

Surprisingly high 


3 

6 

11 

20 

Upper 20% 

Upper 20% 

Predictably high 


23 

1 

9 

33 



TOTAL 


84 

49 

70 

203 

Panel B: Category Counts by Region, 8th grade enrollment is > 25 






School's Actual Sign- 
Up Rate 

School's Predicted 
Sign-Up Rate 

Category 


Puget Sound 
Area 

Remainder 
of Western 
Washington 

Eastern 

Washington 

TOTAL 

Bottom 20% 

Bottom 20% 

Predictably low 


13 

8 

20 

41 

Bottom 20% 

Upper 20% 

Surprisingly low 


3 

2 

1 

6 

40th-60th Percentile 

40th-60th Percentile 

Typical school 


8 

7 

4 

19 

Upper 20% 

Bottom 20% 

Surprisingly high 


1 

4 

3 

8 

Upper 20% 

Upper 20% 

Predictably high 


23 

0 

7 

30 



TOTAL 


48 

21 

35 

104 

Panel C: Category Characteristics 







Category 

Average 8th grade 
Enrollment 

Average % Hispanic 

Average 
% White 

Average % 
Female 

Average % 
eligible for 
FRPL 

Average % 
receiving 
Special Ed 

Average % 
passing 8th 
grade math 
test 

Predictably low 

47 

n% 

72% 

45% 

35% 

21% 

22% 

Surprisingly low 

43 

17% 

65% 

48% 

66% 

17% 

25% 

Typical school 

198 

12% 

71% 

48% 

49% 

13% 

58% 

Surprisingly high 

52 

11% 

64% 

45% 

49% 

15% 

30% 

Predictably high 

217 

30% 

35% 

49% 

64% 

12% 

51% 

Panel D: Category Characteristics, 8th grade enrollment is > 25 

Average 8th grade 

Category Enrollment Average % Hispanic 

Average 
% White 

Average % 
Female 

Average % 
eligible for 
FRPL 

Average % 
receiving 
Special Ed 

Average % 
passing 8th 
grade math 
test 

Predictably low 

113 

8% 

78% 

49% 

33% 

9% 

42% 

Surprisingly low 

121 

24% 

58% 

52% 

47% 

8% 

62% 

Typical school 

207 

12% 

70% 

48% 

48% 

13% 

58% 

Surprisingly high 

117 

11% 

66% 

47% 

47% 

14% 

53% 

Predictably high 

238 

30% 

32% 

48% 

63% 

11% 

54% 


Note: Percentile distributions are weighted by 8th grade enrollment. 





Figure 1: Sign-up Rates According to the Washington Student Achievement Council 


8/23/2013 


Cohort 

1 

2 

3 

4 

5 

6 

7 


Expected Grad Year 

2012 

2013 

2014 

2015 

2016 

2017 

2018 

Total Sign-Ups 

By Academic Year 

Eligible Students 

28,093 

28,600 

29,856 

30,549 

31,923 

36,394 

36,208 


Academic Year 07-08 

8 

7 







Complete 

9,062 

6,199 






15,261 

Academic Year 08-09 

9 

8 

7 






Complete 

6,885 

9,871 

11,139 





27,895 

Academic Year 09-10 



8 

7 





Complete 



9,764 

12,356 




22,120 

Academic Year 10-11 




8 

7 




Complete 




11,042 

13,269 



24,311 

Academic Year 11-12 





8 

7 1 



Complete 





12,003 

16,238 


28,241 

Academic Year 12-13 






8 1 

7 1 


Applied 






14,770 

19,025 

33,795 

% of Total Eligible 

57% 

56% 

70% 

77% 

79% 

85% 

53% 


Total Sign-up By Cohort Year 

15,947 

16,070 

20,903 

23,398 

25,272 

31,008 

19,025 

151,623 


1. Preliminary Numbers. Indudes incomplete applications. 


2/coi 

r Srh 


College Bound 
Scholarship 

WASHINGTON 


ViV# WAS 1 1 1 NGTON STU DENT 

ACHI EVEMENT CO UNCIL 

* FnilCATION • OPPORTUNITY • RFSUITS 


Source: Personal communication from Rachelle Sharpe, Ph.D., Senior Director of Student Financial Aid and 
Support Services, Washington Student Achievement Council, August 23, 2013 
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Figure 2: Correspondence of Schools' Predicted and Actual Sign-Up Rates, by Region 
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Appendix: Regional Officer Interview Questions 





Background (5 min) 

I'd like to start with some questions about your background and role. 

• How long have you been working in your current role as a College Bound regional officer with the College 
Success Foundation? 

• What did you do before working for the College Success Foundation? How do your prior experiences relate 
to the work you're doing for the College Success Foundation? 

• Besides the College Bound Scholarship program, do you work with other college or career programs? [If 
yes] How much of your time is dedicated to the College Bound Scholarship program versus these other 
programs? 

• To what extent do you interact with the other College Bound regional officers? [Probe if needed] When and 
how do you communicate? What topics do you typically cover? 

1. Work with schools and districts in the region (5-10 min) 

Now I'd like to ask about your work with schools and districts to promote the College Bound Scholarship program. 

• How many middle schools are there in your region? How many districts? (It's okay to estimate if you don't 
have the exact numbers on hand.) 

o How many of these do you work with? 

o Do you work with any high schools? [If yes] About how many? And of how many are there in the 
region? 

o With so many schools in your region, it might be difficult to get to each one. How do you determine 
which schools or districts to prioritize? 

• How do you normally interact with these schools and districts? 

o Who is your main point of contact with the districts? With the schools? 

o What, if any, staff trainings do you conduct with schools or districts? [If offer trainings] Can you 
please describe these trainings? Are they with individuals or groups? Where and when are they 
held? Who attends? What topics are covered? How do you encourage people to come? 
o What kinds of workshops or events do you plan or host with schools or districts to promote the 
program or encourage students to participate? [If offer events] Can you please describe these 
workshops or events? Where and when are they held? Who attends? What topics are covered? 
How do you encourage people to come? 

o To what extent do you work with schools or districts to advise eligible students or their families 
about the program? [If offer advising:] Can you please describe how this works? How do you reach 
people? What topics do you cover when you advise them? 
o What other activities do you use to engage schools or districts with the program and get students 
to sign up for it? [If offer other activities] Please describe them. 

• Of all the ways you work with schools and districts what approaches do you think have been most 
successful in getting students to sign up for the College Bound Scholarship program? 

• What have been the greatest challenges in working with schools or districts? 

• To what extent do you find these challenges are particular to specific districts or types of schools? [If so] 
What do you think makes this so? 

2. Work with partner organizations (5-10 min) 

Now I'd like to ask some questions about the other kinds of organizations you work with in the region. 

• Beyond districts and schools, what community organizations do you partner with to encourage students to 
participate in the College Bound Scholarship program? 

o How did you develop these partnerships? 

o Do you (or the districts or schools) have any formal agreements in place with these partner 
organizations-for example, contracts or memoranda of understanding? 

• How often and in what ways do you interact with these partner organizations? 

• What do these organizations do to encourage students to participate in the College Bound Scholarship 
program? 

o How do they get students to sign up for the program? 
o How do they help students to prepare for college? 
o What else do they do to promote participation in the program? 



• To what extent do you think these partner organizations have helped increase the number of eligible 
students who sign up for the College Bound Scholarship? 

3. College awareness and college-going culture (5-10 min) 

Now I'd like to ask you some questions about efforts to build college awareness and a college-going culture in your 
region. 

• What are districts, schools, or individual school staff and faculty that you work with in the region doing to 
support: 

o General college awareness? 
o Understanding of college readiness? 
o Understanding of how to pay for college? 

• What do the community partner organizations that you work with do to support: 

o General college awareness? 
o Understanding of college readiness? 
o Understanding of how to pay for college? 

• If you had to give a grade from A to F, how would you rate the general college-going culture in your region? 
On the same scale, how would you rate each of the following: 

o General college awareness? 
o Understanding of college readiness? 
o Understanding of how to pay for college? 

• How much variation do you see in the college-going culture across the various middle schools in your 
region? [If appropriate] What about across the high schools? 

• What do you think causes this variation? 

• What do you think schools, districts, and partner organizations do particularly well to promote a college- 
going culture in the region? 

• In what areas do you think they could do more to promote the college-going culture? 

• How has the availability of the College Bound Scholarship helped to foster a college-going culture in your 
region? 

4. Student participation (5-10 min) 

Let's switch gears and talk about student participation in the College Bound Scholarship program. 

• How do you identify students who might be eligible for the program? 

o What information do you receive on eligible students? How do you receive this information? 
o What do you do with the information when you get it? 

• We understand that WSAC provides materials (including a "toolbox") to help middle school counselors 
encourage and track students' participation in the program. Do you ever use these WSAC materials? [If yes] 
Of all the materials available, which do you think are the most useful? Why? 

• What proportion of eligible students in your region do you think sign up? (It's okay to estimate if you don't 
have the exact figures.) 

• How does the sign-up rate vary across middle schools and districts within your region? What do you think 
causes this variation? 

• How has the sign-up rate changed over time? What do you think influenced the change? 

• What kinds of students do you think are most likely to sign up? Why do you think these students are more 
likely to sign up than others? 

• What kinds of students are least likely to sign up? Why do you think these students are less likely to sign 
up? 

• In your opinion, what works best to encourage students to sign up for the program? 

• What are the biggest challenges to getting students to sign up? 



5. Program progress and results (5-10 min) 

In this last section, I'd like to ask you about your impressions of the progress of the College Bound Scholarship 
program over time and how well it achieves its goals of improving low-income students' college preparation and 
enrollment. 

• In general, how well known do you think the College Bound Scholarship is among the people you work with 
in your region? 

• For each of the following types of people, I'd like you to rate how well known the program is on a scale of 1 
to 10, with 1 being completely unknown and 10 being completely known,: 

o Middle school principals? 
o Middle school guidance counselors? 
o Other middle school faculty and staff? 
o High school principals? 
o Students and their families? 

o Community organizations that work with eligible youth? 

• In your experience, how has knowledge of the program changed over time? What do you think influenced 
these changes? 

• In what ways do you think the College Bound Scholarship actually influences students' behavior while 
they're still in middle or high school? 

o To what extent do you think it makes them prepare better for college? Does it change the sequence 
of courses they take? 

o How about encouraging them to stay out of trouble during adolescence? 
o To what extent does it change students' beliefs about their own ability to go to college? 
o To what extent does it change their college aspirations? 
o What other ways do you think it might change students' behavior? 

• What is your sense of how effective the program is at getting students to enroll in college who might not 
otherwise have done so? 

o To what extent do you think it changes the type of college students enroll in? 
o To what extent do you think it helps them to persist in college? 
o What factors do you think make it effective? 
o What factors do you think limit the program's success? 

• What other ways might the state use its resources to get low-income middle school students to succeed in 
college? 

Wrap-Up (less than 5 min) 

• What other things do you think we should know about your efforts or the efforts of the organizations you 
work with to encourage students to participate in the College Bound Scholarship program? 

• Do you have any questions for us? 



Appendix: Principal/Guidance Counselor Interview Questions 

Background 

A. To begin, how long have you been working in your current role as [principal/guidance 
counselor] at your school? 

B. What are your main responsibilities specifically with respect to the College Bound 
Scholarship program? 

Promoting the College Bound Scholarship Program (15-20 min) 

In this first section we'll discuss activities to promote the College Bound Scholarship program at 
your school. 

• [PRINCIPALS] What are the main activities used at your school to promote the program and 
encourage students to sign up for it? We don't need to hear about everything, just those 
activities you consider most important to the program's success. 

• [PRINCIPALS] Who is the primary individual responsible for conducting these activities? 

o Is working to support the College Bound program part of their expected job duties? 

o Roughly how much time do you expect them to spend during a year with work 
related to this specific program, as a percentage of their FTE? 

o What resources (financial or others) are available to help them promote the 
program or get students to sign up? 

o What individual do you consider to be most accountable for the program's 
success? 

• [COUNSELORS] What are the main activities you use to promote the program and 
encourage students to sign up for it? We don't need to hear about everything, just those 
activities you consider most important to the program's success. 

o Do you consider working to support the College Bound program part of your 
expected job duties? 

o Roughly how much time do you spend during a year with work related to this 
specific program, as a percentage of your FTE? 

o What resources (financial or others) are available to help you promote the program 
or get students to sign up? 

o Of all your job duties, how would you rank the relative importance of your work 
with the College Bound program? Is it less important, about the same, or more 
important than most of your other duties? 

• To what extent are other faculty and staff expected to help promote the program and get 
eligible students to participate? 

o Is it part of anyone else's expected job duties? 

o What resources (financial or others) are available to help them promote the 
program or get students to sign up? 

• In your view, what individual is the strongest champion for the College Bound program at 
your school? 

o What makes them an effective champion for the program? 

o What could your school or district do to help them be even more effective? 

• What organizations in the community are most important to the program's success at your 
school? 

o Do any of these partners actually sign students up for the program? What else do 
they do to help increase the number of eligible students who sign up for the 
College Bound Scholarship? 



o Does the school (or the district) have any formal agreements in place with these 
partner organizations-for example, contracts or memoranda of understanding? 

• What are the main things the district does to support the program's success at your 
school? 

o Does the district place any accountability requirements on you or your school with 
respect to your College Bound program performance? 
o Is there anyone at the district offices that you consider to be a champion for the 
program? If so, who (ideally, you can tell me their role - not their name)? 

Targeting eligible students to encourage participation (5-10 min) 

Let's switch gears and talk about how you identify and target eligible students for participation in 
the College Bound Scholarship program. 

A. What proportion of eligible students in your school do you think sign up? (It's okay to 
estimate if you don't have the exact figures.) 

1. How has your school's sign-up rate changed over time - would you say it's decreased, 
stayed about the same, or increased?? 

2. What do you think influenced the change? 

B. Do you receive information on sign-up rates from WSAC? 

1. [IF YES re WSAC and MORE THAN 1 MS in district] What is your district's current sign- 
up rate according to WSAC? 

2. [IF NO re WSAC and MORE THAN 1 MS in district] Do you know your district's current 
sign-up rate? If so, about what is it? 

C. [COUNSELORS] When promoting the program, to what extent do you focus on specific 
types of eligible students? 

1. Which types of students do you focus on? 

2. How do you decide which types of students to focus on? 

3. Do you ever ask students— whether individuals or in groups— to sign the pledge without 
first knowing if they are eligible? 

D. [COUNSELORS] Do you receive lists of eligible students from WSAC, the district, or another 
source? 

1. [IF YES] How and when do you receive this information? 

2. [IF YES] Is there anything else you do to identify eligible students (besides use data from 
WSAC, the district, or another source)? 

3. [IF NO] How do you identify students who might be eligible for the program? 

E. [COUNSELORS] When and how often during the school year do you reach out to eligible 
students to encourage them to sign up for the program? 

1. What does the typical sign-up process look like? 

2. Where is the process most likely to break down? 

F. [COUNSELORS] What are the characteristics of students who are most likely to sign up? 
Why do you think these students are more likely to sign up than others? 

G. [COUNSELORS] We understand that WSAC provides materials (including a "portal") to help 
middle schools encourage and track students' participation in the program. Do you ever 
use these WSAC materials? 

1. [IF YES] Of all the materials available, which do you think are the most useful? Why? 

2. [IF NO] Why don't you use these materials? 

3. What could improve the WSAC materials? 

H. [COUNSELORS] About what percentage of the time would you say you use the electronic 
(versus paper) applications provided by WSAC? 



Program progress and results (5-10 min) 

In this last section, I'd like to ask you about your impressions of the progress of the College Bound 
Scholarship program over time and how well it achieves its goals of improving low-income 
students' college preparation and enrollment. 

A. To what extent do you think students and families understand the program's eligibility 
requirements? How has this changed over time - would you say it's decreased, stayed 
about the same, or increased? 

B. To what extent do you think students and families trust that the program will actually be 
available to pay for college costs when they need it? How has this changed over time - 
would you say it's decreased, stayed about the same, or increased? 

C. Of all the things your school does to encourage students to sign up for the College Bound 
Scholarship program, what approaches do you think have been most effective ? 

D. What have been the greatest challenges to getting students to sign up for the program? 

Wrap-Up (less than 5 min) 

Before we wrap up, I'd like you to step back and think about the broader college going culture at 
your school. 

• If you had to give your school a grade from A to F, how well do you think your school 
promotes... 

o Students' general college awareness? 
o Students' understanding of college academic readiness? 
o Students' and families' understanding of how to pay for college? 

• What average grade do you think your school would have earned on these items [IF THERE 
MORE THAN 4 YRS] ...in the first year of the program (2012-13 school year)? / [IF THERE 
LESS THAN 4 YRS] ...in the first year you worked there? 

• To what extent has the availability of the College Bound Scholarship helped to foster the 
college-going culture at your school? 

• What other things do you think we should know about your or your school's efforts or the 
efforts of the people you work with to encourage students to participate in the College 
Bound Scholarship program? 

• Do you have any questions for us? 



